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Verification  of  the  Threshold  Test  Ban  Treaty  [TTBT]  cannot  be  performed 
merely  by  estimating  explosive  yields  on  the  basis  of  observed  seismic  magni¬ 
tudes  and  concluding  that  a  violation  has  occurred  if  one  or  more  yield  esti¬ 
mates  exceed  the  TTBT  limit  of  150  KT.  It  is  necessary  to  take  into  account  the 
uncertainties  in  the  seismic  magnitudes,  in  the  magnitude  -  yield  relation,  and 
especially  in  the  magnitude  bias  between  the  test  site  at  which  the  magnitude  - 
yield  calibration  explosions  were  detonated  and  the  test  site  of  the  explosions 
being  monitored.  For  monitoring  one  explosion  at  a  time,  these  uncertainties 
can  be  taken  into  account  by  placing  confidence  limits  around  the  yield  esti¬ 
mates.  For  verifying  TTBT  compliance  of  an  ensemble  of  explosions  considered 
as  a  whole,  however,  this  technique  cannot  be  used,  since  the  confidence  limits 
placed  around  the  yield  estimates  of  different  explosions  are  correlated  due  to 
the  use  in  every  case  of  the  same  values  of  the  parameters  relating  magnitude 
to  yield.  In  order  to  examine  TTBT  compliance  for  groups  of  explosions,  a  test 
can  be  performed  of  the  hypothesis  that  the  yields  have  some  fixed  distribution 
in  which  all  the  values  are  less  than  150  KT.  This  compliance  hypothesis  would 
be  rejected  if  some  minimum  number  of  yields  which  are  calculated  using  the 
observed  magnitudes  exceed  a  certain  threshold  which  is  a  function  of  both  the 
minimum  number  of  exceedences  and  tue  maximum  allowed  probability  of  issu¬ 
ing  a  false  alarm.  For  a  small  false  alarm  probability,  the  threshold  at  which  the 
compliance  hypothesis  is  rejected  will  far  exceed  the  TTBT  limit  of  150  KT.  This 
particular  hypothesis  test  is  not  optimum,  but  it  is  preferable  to  more  powerful 
ones  in  that  it  is  not  susceptible  to  manipulation  by  the  party  conducting  the 
explosions. 

The  magnitude  -  yield  relation  may  be  calibrated  from  a  set  of  explosions 
with  known  yields  by  means  of  a  least-squares  regression  which  treats  the  mag- 
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nitudes  as  uncertain  quantities  and  the  yields  as  fixed  or  by  a  maximum- 
likelihood  regression  which  treats  both  magnitudes  and  yields  as  uncertain.  For 
the  purposes  of  TTBT  monitoring,  it  is  important  to  determine  not.  only  the  bos!, 
estimates  of  the  parameters  relating  magnitude  to  yield  but  also  the  variances 
of  these  estimates. 
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INTRODUCTION 


Throughout  the  25-year  history  of  Project  VEl^A  Uniform,  considerable  effort 
has  been  expended  on  research  related  to  the  accurate  measurement  of  the 
seismic  magnitudes  of  underground  nuclear  explosions  and  the  estimation  of 
explosive  yields  using  those  magnitudes.  This  research  (much  of  which  has  been 
summarized  by  Bache  et  al.,  1981,  and  Bache.  1982)  has  addressed  such  issue* 
as  instrumentation,  signal  measurement  (both  analog  and  digital),  amplitude- 
distance  relations,  station  magnitude  corrections,  test  site  magnitude  biases, 
properties  of  emplacement  media,  effects  of  depth  of  burial,  and  source  cou¬ 
pling.  Although  in  this  report  we  shall  examine  both  the  determination  of  mag¬ 
nitudes  and  the  estimation  of  yields,  we  shall  concentrate  primarily  on  a 
different  issue  which  is  the  logical  successor  to  these  topics  :  given  the  uncer¬ 
tainties  in  seismic  magnitudes  and  in  the  yield  estimation  procedure,  how  can 
the  resulting  yield  estimates  be  used  in  an  effective  manner  for  monitoring  a 
Threshold  Test  Ban  Treaty  [TTBT]  ?  We  shall  examine  this  question  by  placing 
confidence  limits  around  the  estimates  of  individual  yields  and  by  performing 
classical  hypothesis  tests  for  TTBT  compliance  of  ensembles  of  events.  We  shall 
next  examine  the  technique  for  estimating  those  yields  which  were  used  in  the 
TTBT  compliance  testing  procedures.  We  shall  place  special  emphasis  on  the 
uncertainty  in  those  estimates,  since  it  is  this  uncertainty  which  limits  our  capa¬ 
bility  of  verifying  the  TTBT. 
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TESTING  TTBT  COMPLIANCE 


We  shall  first  assume  that  the  seismic  magnitudes  m-t,  have  been  measured 
for  a  suite  of  explosions  and  that  the  yields  of  these  explosions  have  been 
estimated  using  these  values  of  m*  and  some  specified  formula  which  relates 
magnitude  to  yield.  We  shall  later  examine  this  yield  estimation  procedure,  but 
for  now  wc  shall  merely  take  it  to  be  given,  and  we  shall  investigate  how  the 
estimated  yields  and  the  uncertainties  in  both  the  magnitudes  and  in  the  yield 
estimates  may  be  used  to  quantify  the  confidence  with  which  it  can  be  said  that 
the  suite  of  events  was,  or  was  not,  in  compliance  with  a  TTBT. 

1.  Statistical  Model  of  the  Magnitude  -  Yield  Relation 

TTBT  compliance  for  a  set  of  n  explosions  of  unknown  yields  will  be  tested 

using  the  n  measured  seismic  magnitudes  mit  m2 .  m*,.  Although  v.e  could 

use  surface-wave  magnitudes  for  yield  estimation,  we  shall  herein  assume  that 
the  magnitudes  are  all  mj  rather  than  Ma.  We  assume  that  these  observations 
are  linearly  related  to  the  logarithms  of  the  yields  : 

m.j  =  a  +  (IWj  +  ej  (l) 

where  Wj  =  log  Yj  and  Yj  is  the  yield  of  the  7  th  event.  Estimates  of  the  intercept 
and  slope  of  this  relation,  which  we  shall  denote  as  a0  and  0O,  can  be  obtained 
from  a  linear  fit  of  observed  magnitudes  to  the  known  yields  of  calibration  explo¬ 
sions.  A  technique  for  performing  this  calibration  magnitude-yield  regression 
will  be  presented  later.  The  intercept  a  in  equation  (1)  includes  an  additive  con¬ 
stant  c  which  represents  the  magnitude  bias  between  the  test  site  at  which  the 
magnitude-yield  calibration  events  were  detonated  and  the  test  site  of  the  n 
events  with  the  unknown  yields.  This  magnitude  bias  e  is  due  to  differences  in 
the  amount  of  anelastic  attenuation  of  seismic  waves  which  takes  place  in  the 
crust  and  mantle  beneath  the  two  test  sites.  For  those  events  of  unknown  yield, 


a  and  /9  are  subject  to  considerable  uncertainty  which  we  model  in  terms  of 
their  expectations  cto  and  from  the  calibration  set.  The  uncertainty  in  a  and  /? 
relates  to  coupling  and  the  unknown  characteristics  of  the  test  site  as  well  as 
the  variance  among  the  calibration  events.  We  assume  that  this  can  be  incor¬ 
porated  into  the  variance-covariance  structure  of  a  and  /3,  say  by  the  covariance 
matrix 
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The  error  term  in  equation  (1)  is  assumed  to  have  variance  af  which  comes 
from  two  sources.  The  first  is  the  error  in  the  measurement  of  mb  (after  any 
available  station  corrections  have  been  applied)  mainly  due  to  stochastic  propa¬ 
gation  effects  which  are  not  adequately  compensated  for  by  the  station  correc¬ 
tions,  and  the  second  source  of  error  is  the  scatter  in  mb  for  a  fixed  yield  which 
is  due  to  differences  in  the  coupling  efficiency  at  the  n  source  locations  within 
the  test  site.  We  shall  later  consider  these  two  sources  of  magnitude  error 
separately;  for  now,  we  shall  simply  add  the  variances  to  obtain  the  single  vari¬ 
ance  af  for  the  magnitude  of  the  jth  event. 

Although  we  shall  later  discuss  the  determination  from  calibration  data  of 
the  parameters  cto  and  /So  as  well  as  the  uncertainties  aa,  Op,  and  oap,  we  shall  for 
now  assume  that  these  are  fixed  quantities  which  are  known  a  priori.  For  pur¬ 
poses  of  illustrating  the  compliance  testing  procedures,  we  shall  use  as  values  of 
these  parameters  certain  results  which  will  be  derived  in  a  subsequent  section 
of  this  report.  We  emphasize  that  these  values  are  for  illustration  purposes  only; 
the  determination  of  the  parameters  which  should  be  used  in  practice  for  TTBT 
monitoring  must  be  derived  by  a  detailed  analysis  of  a  large  data  set  of  carefully 
selected  calibration  explosions  with  known  yields.  Although  we  shall  investigate 
the  methodology  which  should  be  used  in  ich  a  study,  in  this  report  we  shall 


not  attempt  to  accumulate  the  data  set  which  would  be  required  to  carry  out 
the  calibration  in  practice,  and  the  values  which  we  shall  use  here  are  therefore 
unreliable.  They  will,  however,  serve  to  show'  how  TTBT  compliance  can  be 
tested,  given  some  better  set  of  values  for  these  same  parameters.  The  values 
which  we  shall  use  herein  are  listed  in  Table  1.  It  is  important  to  note  that  for 
testing  TTBT  compliance  of  the  n  events  we  must  use  values  of  ot0  and  oa  given 
by 

a0  =  a0.cai  +  £0 

(3) 

°l  =  Olcai  +  9>2 

where  e0  represents  the  estimate  of  the  magnitude  bias  of  the  test  site  of  the  n 
events  relative  to  the  site  of  the  magnitude-yield  calibration  events,  and  where  <p 
is  the  standard  deviation  of  this  bias  estimate.  The  value  of  the  magnitude  bias 
between  US  and  USSR  test  sites  and  the  uncertainty  in  that  value  have  both  long 
been  controversial  topics,  and  rather  than  address  them  here  we  shall  simply 
choose  several  different  trial  values  for  illustration  purposes.  We  shall  use  3 
different  possible  values  of  e0  and  2  of  50,  as  is  shown  in  Table  1.  We  shall  thus 
test  compliance  under  6  different  assumptions  about  the  magnitude  bias 
between  test  sites,  namely  that  c0  =  0.20  ±  0.05,  0.20  ±  0.10,  0.25  ±  0.05,  0.25  ± 
0.10,  0.30  ±  0.05,  and  0.30  ±  0.10.  This  means  that,  in  accordance  with  equation 
(3).  we  shall  test  TTBT  compliance  for  the  6  possibilities  a0  =  4.0B2  ±  0.059,  4.082 
±  0.105,  4.132  ±  0.059,  4.132  ±  0.105,  4.182  ±  0.059,  and  4.182  ±  0.105.  This 
range  of  values  will  serve  to  show  how  strongly  the  question  of  compliance  is 
affected  by  the  estimate  of  the  magnitude  bias  and  by  the  uncertainty  in  that 
estimate. 

It  will  be  recalled  that  the  parameter  aj  in  Table  I  is  the  standard  deviation 
of  the  error  term  ej  in  equation  (l).  In  Table  1  we  have  adopted  a  constant  value 
Oj  =  0.07  for  j  =  1 . n,  and  we  shall  now  attempt  to  justify  this  procedure.  If 


TABLE  I 


Values  of  parameters  to  be  used  in  this 
study  for  testing  TTBT  compliance 


Shagan  River  —  calibration  site  mb  bias  Cq  = 


0.20 

0.25 

0.30 


(3  trial  values) 


standard  deviation  of  the  preceding  estimate  <p 


0.05  (2  trial  values) 
0.10 


intercept  of  the  calibration  magnitude  -yield  relation  a0tCai  =  3.882 


hence  for  Shagan  a0  = 


4.08 

4.13 

4.18 


if  e0  =  0-20 
if  e0  =  0.25 
if  e0  =  0.30 


slope  of  the  magnitude —yield  relation  j?0  =  0.890 

standard  deviation  of  the  calibration  intercept  Oa.ctl  =  0.031 

f  0.059  if<p=0.05 
hence  at  Shagan  a„  =  J  0  105  if  ^  =  0. 10 

standard  deviation  of  the  slope  Op  =  0.013 
covariance  of  the  intercept  and  slope  oal ;  =  -0.000393 
standard  deviation  of  mb  for  each  event  (Jj  =  0.07 

These  values  are  for  illustration  purposes  only  and  are  not  intended  to  be  used 
in  practice. 


the  n  magnitudes  m,t  m2 . are  determined  using  a  large  network  of  glo¬ 

bally  distributed  stations,  for  which  the  individual  station  corrections  (for  the 
given  test  site)  average  out  to  zero,  then  the  uncertainty  in  the  calculated  mag¬ 
nitude  is  just  the  standard  deviation  of  the  mean  of  the  magnitudes 
measured  at  each  of  the  Nj  stations  i.  If  the  magnitudes  are  determined  using 
only  a  few  stations,  then  the  uncertainty  in  m.j  is  larger  than  this  on  account  of 
the  uncertainty  in  a  possible  network  magnitude  bias.  Since  the  events  which 
are  of  interest  from  the  point  of  view  of  investigating  TTBT  compliance  are  large 
ones  which  are  detected  by  many  stations,  we  can  assume  that  any  network  bias 
is  small  and  that  the  standard  deviation  of  rrij  is  likewise  small.  Although  the 
uncertainty  in  the  calculated  value  for  rrij  is  small  for  these  large-magnitude 
events,  a  larger  uncertainty  is  required  to  account  for  the  scatter  about  the 
magnitude-yield  relation  due  to  variations  in  coupling  eflficieny.  (Recall  that  the 
variance  of  is  the  sum  of  both  these  uncertainties.)  We  shall  present  later  a 
technique  for  estimating  the  coupling  scatter,  but  for  now  we  take  it  to  be 
known  a  priori  as  oc  =  0.07.  This  value  of  the  magnitude  scatter  (for  events  of 
the  same  yield)  due  to  coupling  is  larger  than  the  magnitude  scatter  (for  a  sin¬ 
gle  event)  due  to  measurement  of  across  the  network,  since  the  events  of 
interest  for  TTBT  compliance  are  recorded  at  many  stations  Nj.  The  magnitudes 
which  we  shall  use  to  illustrate  TTBT  compliance  testing  are  listed  in  Table  II. 
These  data  are  taken  from  Sykes  and  Cifuentes  (1984),  who  used  magnitudes 
reported  to  the  International  Seismological  Center  [ISC]  bulletin  and  then 
applied  to  them  station  corrections  which  were  derived  from  the  8  largest 
events.  We  shall  neglect  the  slight  differences  among  the  listed  standard  devia¬ 
tions  of  nif,  for  the  n  =  22  events  and  set  of  =  of  +  w  0.072  +  0.022  for  all 
events,  thus  obtaining  Oj  w  0.07  for  j  =  1,  ....  n.  Although  the  preceding  calcula- 
'  i  is  an  approximate  one,  it  would  not  be  worthwhile  to  replace  it  by  a  more 
nearly  exact  one  in  which  the  different  values  of  for  different  events  are 


taken  into  account,  since  these  small  differences  are  less  than  the  uncertainty 
in  the  value  of  0.07  which  is  used  for  the  parameter  ac.  Although  we  shall  use  a 
single  value  of  Oj  for  all  events,  the  formalism  which  wc  shall  derive  for  testing 
TTBT  compliance  does  not  depend  on  the  use  of  this  approximation. 

2.  Confidence  Intervals  for  Yield  Estimates 

The  estimated  log  yield  of  the  ;  th  event,  Wp1,  can  be  determined  from  the 
j  th  observed  magnitude  as 

T  =  W 

The  estimated  yield  is  normal  with  mean  Wj  and  variance 

var(  Wf)  =  (  al  +  2aap  W,  +  aj  Yif  +  of)/ 0$  (5) 

which  depends  on  the  true  log  yield  W}.  in  order  to  derive  a  100(1 -a)% 
confidence  interval,  we  substitute  the  right-hand  side  of  equation  (5)  into  the 
denominator  of  the  inequality 

=£  Zt/z  (6) 

where  Zgj z  is  the  upper  a/ 2  percentage  point  on  the  normal  distribution.  (Note 
that  a  in  this  context  is  a  different  variable  from  the  a  which  denotes  the  inter¬ 
cept  in  equation  (l)).  This  substitution  results  in  a  quadratic  expression  for  Wj, 
the  two  roots  of  which  bound  the  confidence  interval.  Since  we  are  really 
interested  only  in  the  lower  magnitude  bound  and  not  on  the  upper  bound  on  the 
confidence  interval,  we  shall  replace  the  right-hand  side  of  equation  (6)  with  Za 
so  that  the  confidence  interval  is  one-sided.  A  possible  compliance  testing  pro¬ 
cedure  would  then  be  to  challenge  any  yield  for  which  the  lower  bound  on  the 
95%  confidence  interval  was  greater  than  the  maximum  yield  which  is  permitted 
by  the  TTBT,  namely  150  KT. 


I  Wl  ~  Vj  I 

Vvar(  &7*‘) 
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TABLE  III 

95%  confidence  intervals  for  yield  estimates 

(1)  Yield  (KT)  estimated  using  e0  =  0.20 

(2)  Lower  bound  on  (1)  if  <p  =  0.05 

(3)  Lower  bound  on  (1)  if '/  =  0. 10 

(4)  Yield  (KT)  estimated  using  t0  =  0.25 

(5)  Lower  bound  on  (4)  if  <p  =  0.05 

(6)  Lower  bound  on  (4)  if  tp  —  0.10 

(7)  Yield  (KT)  estimated  using  £o  =  0-30 
(B)  Lower  bound  on  (7)  if  <p  =  0.05 

(9)  Lower  bound  on  (7)  if  <p  =  0.10 


event 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

Aug.  29, 

1978 

131 

91 

78 

115 

80 

68 

101 

70 

60 

Sep.  15, 

1978 

130 

90 

77 

114 

79 

68 

100 

69 

60 

Nov.  4, 

1978 

48 

33 

28 

42 

29 

25 

37 

25 

22 

Nov.  29, 

1978 

141 

98 

84 

124 

86 

74 

109 

76 

65 

Jun.  23, 

1979 

249 

172 

148 

219 

152 

130 

192 

133 

114 

Jul.  7, 

1979 

94 

65 

56 

83 

57 

49 

73 

50 

43 

Aug.  4, 

1979 

217 

150 

129 

190 

132 

113 

167 

116 

99 

Aug.  18, 

1979 

222 

154 

132 

195 

135 

116 

171 

119 

102 

Oct.  28, 

197  9 

139 

96 

83 

122 

85 

73 

108 

74 

64 

Dec.  2, 

1979 

142 

98 

84 

125 

86 

74 

110 

76 

65 

Dec.  23, 

1979 

222 

154 

132 

195 

135 

116 

171 

119 

102 

Jun.  29, 

1980 

67 

46 

40 

59 

41 

35 

52 

36 

31 

Sep.  14, 

1980 

248 

172 

147 

218 

151 

129 

191 

132 

114 

Oct.  12, 

1980 

116 

80 

69 

102 

70 

60 

89 

62 

53 

Dec.  14, 

1980 

127 

88 

75 

111 

77 

66 

98 

68 

58 

Dec.  27, 

19  80 

103 

71 

61 

90 

62 

54 

79 

55 

47 

Apr.  22, 

1981 

127 

88 

75 

111 

77 

66 

98 

68 

58 

Sep.  13, 

1981 

169 

117 

100 

148 

103 

88 

130 

90 

77 

Oct.  \ 8, 

1981 

156 

108 

92 

137 

95 

81 

120 

83 

71 

Dec .  27  , 

1981 

267 

185 

159 

235 

163 

139 

206 

143 

123 

Apr.  25, 

1982 

180 

124 

107 

158 

109 

94 

139 

96 

82 

Jul .  4 , 

1982 

254 

176 

151 

223 

154 

132 

196 

136 

116 

Table  111  shows  the  results  of  applying  this  test  to  each  of  the  events  in 
Table  II,  using  the  values  of  oto,  (}0,  oa,  ap,  oap,  and  Oj  taken  from  Table  1.  Yfe  see 
that  for  3  of  our  6  trial  values  of  e0  ±  the  lower  limit  on  the  confidence  interval 
surrounding  the  yield  estimate  exceeds  150  KT  for  at  least  one  event,  and  for  the 
other  3  trial  values  it  does  not.  (The  confidence  limits  on  the  yields  are  of 
course  functions  not  only  of  the  trial  values  of  Eo  and  <p  but  also  of  the  values 
which  were  selected  a  priori  for  the  other  parameters  in  Table  I.)  The  procedure 
works  very  well  for  testing  one  yield  at  a  time,  but  it  would  be  difficult  to  extend 
it  to  multiple  magnitude  readings,  such  as  determining  whether  ail  the  events  in 
Table  II  are  in  compliance,  since  the  estimators  are  highly  correlated  through 
the  variance-covariance  structure  for  a  and  /?  which  appears  in  equation  (5). 
That  is,  since  the  22  lower  bounds  on  the  yield  estimates  are  not  independent  of 
one  another,  we  cannot  simply  count  the  number  of  times  in  Table  111  for  which 
the  lower  limit  on  the  yield  estimate  (for  a  given  value  of  Eo  and  a  given  value  of 
<p)  exceeds  150  KT  and  conclude  that  this  tally  represents  the  number  of  events 
for  which  we  are  95%  certain  that  the  150  KT  threshold  was  exceeded.  For  pur¬ 
poses  of  monitoring  the  TTBT,  we  are  interested  in  determining  whether  the  pat¬ 
tern  of  testing  as  a  whole,  as  represented  by  all  22  events,  has  been  in  compli¬ 
ance.  We  must  therefore  use  another  approach  as  an  alternative  to  this  one  of 
surrounding  every  yield  estimate  with  a  confidence  interval. 

3.  Hypothesis  Testing 

Since  the  compliance  testing  scheme  based  on  confidence  intervals  around 
the  yield  estimates  cannot  be  used  for  testing  ensembles  of  events,  we  shall 
examine  as  an  alternative  a  test  of  the  null  hypothesis  that  all  events  in  the  data 
set  are  in  compliance  with  the  TTBT.  Before  we  apply  this  hypothesis  test  to  the 
data  in  Table  II,  we  must  adjust  the  test  so  that  the  false  alarm  probability  (the 
probability  that  the  compliance  hypothesis  will  be  rejected  when  in  fact  it  is 
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true)  is  some  specified  value,  say  5%.  If  we  choose  to  make  the  hypothesis  test 
one  of  rejecting  compliance  if  a  certain  configuration  of  estimated  log  yields 

Wy* ,  W .  Wfl*  exceed  simultaneously  some  given  threshold  T,  then  the  false 

alarm  probability  for  this  test  will  be  determined  by  the  value  of  T,  and  we 
should  therefore  adjust  T  so  that  the  false  alarm  probability  equals  5%  or  what¬ 
ever  other  value  we  have  specified  for  it.  The  threshold  T  for  which  the  false 
alarm  probability  equals  some  chosen  value  such  as  5%  will  depend  on  the  par¬ 
ticular  configuration  of  threshold  exceedences  upon  which  the  test  is  based 
(either  1  or  more  yields  exceeding  T,  or  2  or  more  yields  exceeding  T,  etc.).  No 
matter  what  configuration  of  exceedences  is  used  for  the  test,  if  the  false  alarm 
probability  is  to  be  low,  then  almost  certainly  we  must  set  the  threshold  T  for 
rejecting  the  compliance  hypothesis  to  be  some  value  which  far  exceeds  the 
TTBT  limit  of  150  KT.  That  is,  since  the  yield  estimates  are  uncert  ain  on  account 
of  the  standard  deviations  of  the  parameters  which  are  shown  in  Table  1,  there  is 
a  significant  probability  that  any  event  for  which  we  calculate  the  yield  to  be 
greater  than  150  KT  has  in  reality  a  yield  that  is  less  than  150  KT.  In  order  not 
to  make  the  error  more  often  than,  say,  5%  of  the  time  of  wrongly  concluding 
thfct  the  150  KT  limit  has  been  exceeded,  we  must  monitor  the  TTBT  at  some 
threshold  T  which  is  greater  than  150  KT,  and  only  when  that  greater  threshold 
has  been  exceeded  by  some  particular  configuration  of  calculated  yields  can  we 
reject  the  null  hypothesis  that  the  true  yields  are  in  compliance  with  the  150  KT 
limit.  Although  we  shall  later  examine  a  more  powerful  hypothesis  test  involving 
a  different  configuration  of  threshold  exceedences,  let  us  for  now  adopt  the 
suboptimal  test  of  rejecting  compliance  for  a  set  of  n  magnitudes  if  m  or  more 
calculated  log  yields  exceed  T. 


! 


3. 1.  Hypothesis  Testing  of  at  Least  m  Threshold  Kxcecdcncus 


We  first  choose  to  focus  our  attention  on  rejection  regions  where  at.  least 

one  of  the  estimated  yields  W\at .  fy"1  exceeds  Tu.  The  false  alarm  probability 

is  then  defined  as 

PFA  =  1  -  Prob  (  <:  T.  W |»‘  £  T .  Kst  <  T)  (7) 

given  that  the  magnitudes  are  drawn  from  a  particular  compliance  yield  pattern 

W lt  W% .  Wn,  where  s  150  KT  for  i  =  1 . n.  We  shall  examine  first  the 

case  of  tesing  compliance  for  single  events  (which  can  also  be  done  as  by  placing 
confidence  limits  around  the  estimated  yields,  as  we  have  already  shown),  and 
then  we  shall  examine  the  more  important  case  of  testing  compliance  for 
ensembles  of  events. 


3.1.1.  Null  Hypothesis  of  a  Single  Compliance  Yield 

For  a  single  event,  the  false  alarm  probability  (7)  is  given  by 


P FA 


=  1  -  Prob  (0T‘  «T)  =  i 


Wx  —  T 

(cS’1  +  of)*/ 0o 


(B) 


where  $(z)  is  the  normal  probability  distribution  function  and  where,  by  equa¬ 
tion  (5),  we  have 

=  +  Wfrf  (9) 


For  a  given  value  of  the  single  compliance  log  yield  Wx  in  equation  (8),  say  fYx  = 
log(l50  KT),  one  can  plot  the  false  alarm  probability  against  the  log  yield  thres¬ 
hold  T  to  determine  a  threshold  Ta  for  any  given  false  alarm  probability  a.  Once 
the  threshold  T  has  been  set  at  Ta,  the  probability  of  "detecting"  a  violation  of 
the  form  W',  say 


--  \  •»  * 


Pd(W')  =  Prob  (ITf*  >  Ta)  =  4*1 


~  Ta 

(0’S-,  +  offt/Po 


can  then  be  plotted  as  a  function  of  V1!  to  determine  the  power  of  the  pro¬ 
cedure. 


3. 1.2.  Null  Hypothesis  of  a  Common  Compliance  Yield 

We  now  turn  to  the  more  important  case  of  testing  the  compliance 
hypothesis  for  an  ensemble  of  events.  As  a  particular  example  of  the  hypothesis 
test  based  on  a  single  exceedence  of  the  threshold  T,  let  us  assume  that  the  null 
hypothesis  specifies  that  all  the  tests  were  conducted  at  a  single  compliance 
yield,  i.e. ,  that  =  ...  =  Wn  =  W  s  150  KT  in  equation  (1).  The  false  alarm 

probability  defined  by  (7)  then  depends  on  the  fact  that  the  W*3* .  defined 

by  (4)  have  a  joint  multivariate  normal  distribution  with  means  W  and 

cov(  WJ*  ,  Wl« )  =  (6Jk  of  +  o\ )/ 0§  (11) 

with  djic  =  1  for  j  =  k  and  zero  otherwise  and 

a|  =  <*I  +  2  W  Oap  +  Wzaj  (12) 

For  an  ensemble  of  events,  we  cannot  take  the  product  of  terms  like  the 
right-hand  side  of  equation  (B),  since  the  covariance  structure  (ll)  causes  the 
yield  estimates  of  the  individual  events  within  the  ensemble  to  be  mutually 
dependent.  Instead,  we  note  that  the  ensemble  of  estimated  yields  has  a  joint 
multivariate  normal  distribution,  so  we  can  evaluate  equation  (7)  as  (Johnson 


and  Katz.  1972,  p.  47) 


where 


PFA  =  *  dx 

V2 \nL  j=\  [n/T^XJ 


.  W  -  T 

**  (ff?  +  of)*  /P o 


v  vvv:.-  '*•*.*** 's' v. 


and 


Aj  =  [  1  +  (ffjVffl)]  *  (15) 

The  integral  in  equation  (13)  can  be  evaluated  numerically  using  Gaussian  qua¬ 
drature.  Note  that  equation  (13)  reduces  to  a  product  of  the  independent  pro¬ 
babilities  (8)  if  a\  =  0,  i.e.,  if  the  yield  estimates  are  not  correlated  in  equation 
(11). 

3.1.3.  Null  Hypothesis  of  Multiple  Compliance  Yields 

Although  we  have  thus  far  considered  only  the  null  hypothesis  that  all  the 
events  have  the  same  log  yield  W,  we  shall  now  consider  more  nearly  realistic 
compliance  scenarios  as  null  hypotheses.  For  these  cases  as  well,  the  correla¬ 
tion  of  the  estimated  yields  for  the  different  events  will  exert  a  strong  influence 
on  the  calculation  of  the  probabilities,  but  now  we  will  not  be  able  to  use  the 
preceeding  formalism  to  take  the  correlation  into  account  since  equations  (11)  - 
(12)  will  no  longer  be  applicable. 

In  the  case  of  probabilities  computed  for  multiple  events,  the  false  alarm 
and  signal  {i.e. ,  violation)  detection  probabilities  are  all  functions  of  the  follow- 
ipg  integral  over  all  possible  true  (as  opposed  to  estimated)  values  of  the  slope 
and  intercept  in  equation  (1),  as  it  is  evaluated  under  a  fixed  yield  configuration 
.  *»  : 

Prob  {WYl  <;  T . WF'-ZT) 

=  f /Prob(»T*  «  T\a,p)f{<x,p)d<xdp 

=  //Prob(m1^mr...,mn  a  mT  \  a.p)  f  (a,p)dadp  .  . 


i=i 


(«o  +  PqT)  -  {a  +  pW}) 


f  {<x,p)dadp 


Here  mT  is  the  magnitude  threshold  corresponding  to  the  yield  threshold  T  and 
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.-vVv‘ 


/  (a,/3)  is  the  joint  density  of  a  and  p,  which  wc  assume  to  be  bivariate  normal 
with  means  ao  and  Po  and  with  variances  a|  and  and  covariance  oap  as  given  in 
Table  1.  We  may  thus  substitute  into  equation  (16) 


/<a./S)=/i(a)/aG?|a)  (17) 

where 


fz(P  I  «)  = 


/ 1(«) 

1 


_1 _ 

V2tt  a| 


V2n[a|  -  (cra/J)z/  a|] 


-exp 

exp(- 


(a  ~  a0)2  | 

2a|  J 

[(ft  ~  ftp)  ~  gqg(«  ~  «o)/  °Z]Z 

2[ff|  “  <*Z\ 


(18) 

(19) 


The  double  integral  in  equation  (16)  can  then  be  evaluated  using  the  following 
approximation  : 


fe-*'f(x)dz  »  2/i ,/(*<) 

— ~  i  =  l 


(20) 


where  the  constants  are  the  zeroes  of  the  rath  order  Hermite  polynomial  and 
the  coefficients  are  a  tabulated  weight  function  (Abramowitz  and  Stegun, 
1964,  p.  924).  The  double  integral  then  reduces  to  the  double  sum 


where 


(«o  +  ftp T)-(Aj  +  BiJe  Wj) 


(21) 


4  =  «0  +  '/ZOgXi  (22) 

Bijc  =  00  +  'SziOap/  a<x)xi  +  V2[ct|  -  (Oaf,)'*/ o'Z]xk  (23) 

We  note  that  the  double  integral  (16)  is  more  computationally  intensive  than  is 
the  single  integral  for  the  special  case  (13),  which  can  also  be  evaluated  using 
the  approximation  (20).  We  note  also  that  although  in  Table  I  we  have  chosen  to 
use  a  single  value  of  oj  for  all  22  events,  equation  (21)  shows  that  the  hypothesis 
testing  procedure  could  incorporate  a  different  value  of  (Jj  for  each  event. 


When  the  fixed  set  of  yields  is  entirely  in  compliance,  i.«  ,  when  Wt  lhO  KT 
for  i  =  1,  ....  n,  then  the  complement  of  the  probability  in  equation  (16)  gives 
the  false  alarm  probability  i.e..  the  probability  that  none  of  the  estimated 
yields  for  this  "compliance”  distribution  exceeds  the  threshold  T.  In  order  to 
compute  the  probability  that  the  estimated  yield  of  the  fcth  event  exceeds  this 
threshold  while  the  other  estimated  yields  are  less  than  T,  we  re-write  equation 
(16)  as 


Prob  (  &T‘  T . W?1  >  T, . . ..  -s  T)  = 

r c  (a° +  ~  (« +  pWj) 

J  J  M  n  ai 


t,P)dadfi 


where  Cj  =  1  for  j  i*k  and  ck  =  -1  for  the  fcth  event.  In  order  to  compute  the  pro¬ 
bability  that  this  distribution  of  yields  results  in  exactly  one  estimated  yield 
which  exceeds  the  threshold  T,  we  sum  the  n  individual  probabilities  as  follows  : 

Prob  (W«  =  1)  =  £  Prob  (  Wf*  <T . . Ksl  *  T)  (25) 

jt=i 

where  Ntxc  is  the  number  of  exceedences  of  T  and  where  each  term  in  the  sum 
is  given  by  equation  (24).  The  probability  that  exactly  2  estimated  yields  exceed 


Prob  (NIXC  =2)  =  £  Prob  (&T‘  ^  T . W J*  :>  T . W£*‘  >  T . Kst  <  T)2r) 

y =ut=i  '  ' 

knj 

and  so  on  for  greater  numbers  of  exceedences  of  T.  For  hypothesis  testing,  we 
will  not  be  concerned  so  much  with  the  probabilities  of  exactly  N  exceedences 
of  the  threshold  T  as  with  the  probabilities  of  at  least  N  exceedences;  these  pro¬ 
babilities  are  given  by 

Prob  (Nt zc  ^  l)  =  1  -  Prob  (Ntxc  =  0) 

Prob  ( Ntxc  &:2)  =  Prob  ( Ntxc  &  l)  -  Prob  ( Ntzc  =  l)  (27) 

Prob  (Ntxc  ^3)  =  Prob  ( NtXc  ^  2)  -  Prob  (NBXC  =  2) 


>  .. 
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etc.,  where  Prob  (Nvxc  =0)  is  given  by  equation  (16).  These  same  calculations,  of 
course,  can  be  performed  for  any  given  distribution  of  the  yields  Wi,  not  just  the 
'compliance'  distribution  which  is  used  as  the  null  hypothesis  in  the  test.  In 
particular,  they  can  be  used  to  compute  the  signal  detection  probability  for  any 
given  "violation"  distribution,  in  which  one  or  more  of  the  are  greater  than 
150  KT. 

The  main  items  of  interest  from  the  compliance  hypothesis  testing  point  of 
view  would  be  first  to  find  a  threshold  Ta  which  gives  a  false  alarm  probability 

a  =  Ppn  =  1  —  Prob  (N,xc  =  0)  =  Prob  ( Ntxc  ^  1)  (28) 

with  W  1(  fV2 .  Wn  a  set  of  compliance  yields,  and  then  to  compute  the  probabil¬ 

ity  of  a  single  exceedence  Prob  (Ntxc^  1)  with  the  threshold  T  set  at  Ta  and  with 
Wk  =  W'  >  150  KT  for  the  fcth  event.  This  would  determine  the  signal  detection 
probability  (for  the  given  false  alarm  probability  a)  for  a  single  violation  of  yield 
size  W'.  This  can  be  plotted  as  a  function  of  W'  to  determine  the  probabilities 
under  current  knowledge  of  detecting  single  violations  of  log  yield  W'  with  a  false 
alarm  probability  equal  to  a.  Of  course,  this  is  only  one  type  of  alternative  and 
one  should  design  the  test  so  that  the  most  useful  (for  weapons  development) 
pattern  of  violations  will  be  detected  with  high  probability.  In  this  report  we 
have  performed  tests  for  only  two  patterns  of  violations,  namely  that  of  one  or 
more  yields  exceeding  the  threshold  or  that  of  two  or  more  yields  exceeding  it. 

3. 1.4.  Application  to  Observed  Magnitudes 

We  shall  now  apply  the  hypothesis  testing  procedure  to  the  observed  magni¬ 
tudes  listed  in  Table  II.  We  must  first  select  a  "compliance"  distribution  of 
assumed  yields  to  use  as  the  null  hypothesis.  As  an  example  of  the  simple  case 
which  we  have  discussed  of  a  common  yield  for  all  the  events,  we  shall  make  our 
null  hypothesis  be  that  ail  the  events  are  at  the  limit  of  TTBT  compliance  :  JVj  = 


W 2  =  ...  =  W22  =  log(lf)OKT).  We  choose  to  make  the  hypothesis  lest  one  of 
rejecting  this  null  hypothesis  test  if  one  or  more  estimated  log  yields 
exceed  some  threshold  T.  Substituting  different  values  of  T  into  the  formula 
(21),  we  find  by  trial  and  error  those  values  which  make  the  false  alarm  proba¬ 
bility  a  in  equation  (28)  take  on  the  following  desired  values  :  5%,  10%,  20%,  and 
50%.  Rather  than  expressing  the  results  of  these  calculations  in  terms  of  the  log 
yield  thresholds  Ta,  we  list  in  Table  IV  values  of  the  yield  thresholds  Y?  which  are 
obtained  by  raising  10  to  the  power  Ta  for  each  of  the  4  chosen  values  of  a.  As  is 
shown  in  equations  (22)  and  (23),  the  computation  of  a  for  any  given  value  of  T 
is  strongly  affected  by  the  value  which  is  used  for  cra  and  hence,  through  equa¬ 
tion  (3),  by  the  standard  deviation  <p  of  the  estimate  of  the  USSR  -  US  magnitude 
bias.  Table  IV  thus  lists  a  separate  set  of  results  for  each  of  the  2  trial  values 
which  were  chosen  for  this  parameter.  We  can  now  accept  or  reject  the  null 
hypothesis,  at  any  of  the  4  tabulated  levels  of  significance  a,  by  seeing  whether 
one  or  more  of  the  calculated  yields  in  Table  III  exceed  the  corresponding  thres¬ 
hold  Yf.  An  equivalent  but  simpler  procedure  is  not  to  convert  the  observed 
magnitudes  into  estimated  yields  but  to  convert  the  yield  thresholds  into  magni¬ 
tude  thresholds  and  then  see  whether  any  of  the  observed  magnitudes  exceed 
these  values.  The  magnitude  thresholds  mT  corresponding  to  Ta.  and  hence  to 
Yt,  are  listed  in  Table  IV.  The  conversion  from  yield  to  magnitude  has  been  per¬ 
formed  for  each  of  the  three  tried  values  of  the  magnitude  bias  Eo.  in  accordance 
with  equation  (3).  Comparing  the  magniutdes  listed  in  Table  II  with  the  thres¬ 
holds  m.f,  we  see  that  we  would  reject  the  null  hypothesis  that  all  the  yields  are 
150  KT  with  a  false  alarm  probability  of  10%  if  we  use  E0  =  0-20  and  tp  =  0.05  and 
with  a  false  alarm  probability  of  20%  if  we  use  e0  =  0.20  and  p  -  0.10.  For  the 
other  4  trial  values  of  the  estimate  of  the  magnitude  bias  and  its  uncertainty  Eo 
±  <p,  we  can  reject  the  null  hypothesis  only  with  a  false  alarm  probability  greater 


than  20%. 


TABLE  IV 


Yield  thresholds  Yp  at  which  the  TTBT  can  be  monitored  with  a  given  false  aiarm 
probability  a.  The  null  hypothesis  is  that  all  yields  are  150  KT;  it  will  be  rejected 
if  1  or  more  calculated  yields  exceed  the  threshold  Yp. 


Case  1  : 

99  =  0.05 

a 

Yt 

m;  (e0  =  0.20) 

mT  (eo  =  0.25) 

rriT  (eo  =  0.30) 

V 

5% 

270.0 

6.257 

6.307 

6.357 

10% 

261.3 

6.233 

6.283 

6.333 

20% 

242.7 

6.205 

6.255 

6.305 

r* 

50% 

211.6 

6.152 

6.202 

6.252 

e  . 

Case  2  : 

95  =  0.10 

a 

Yt 

mT  (e0  =  0.20) 

m.T  (eq  =  0.25) 

mT  (eq  =  0.30) 

5% 

334.5 

6.329 

6.379 

6.429 

i. 

10% 

303.0 

6.290 

6.340 

6.390 

20% 

267.0 

6.242 

6.292 

6.342 

50% 

212.3 

6.153 

6.203 

6.253 

■'A 


TABLE  V 

3  assumed  distributions  of  yields  (KT)  to 
use  as  the  null  (compliance)  hypothesis 

if  e0  =  0.20  : 

if  e0  =  0.25  : 

if  e0  =  0.30  : 

131. 

115. 

101. 

i30. 

114. 

100. 

48. 

42. 

37. 

141. 

124. 

109. 

150. 

150. 

150. 

94. 

83. 

73. 

150. 

150. 

150. 

150. 

150. 

150. 

139. 

122. 

108. 

142. 

125. 

110. 

150. 

150. 

150. 

67. 

59. 

52. 

150. 

150. 

150. 
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102. 

89. 

127. 

111. 

98. 

103. 

90. 

79. 

127. 

111. 

98. 

150. 

148. 

130. 

150. 

137. 

120. 

150. 

150. 

150. 

150. 

150. 

139. 

150. 

150. 

150. 

-20- 

• 

•  y-w.  .•  v. 

•  *  •  *  •  •  •  * _>  “  •  *  »  *  t>  *  •  *  «  *  *  *>  *•*•*•*■’  >  •  ■  ‘  •  •'  Jm  > 

The  null  hypothesis  which  we  have  used  in  Table  IV  represents  the  “worst 
possible  case”  compliance  scenario  for  TTBT  monitoring,  namely  that  every 
event  has  the  maximum  allowed  yield.  The  thresholds  Ta  computed  for  this  case 
are  thus  larger  than  they  would  be  for  a  more  nearly  realistic  compliance 
scenario  in  which  only  a  fraction  of  the  22  events  approach  the  150  KT  limit.  We 
may  therefore  take  the  values  listed  in  Table  IV  to  represent  upper  bounds  to 
the  thresholds  which  would  be  computed  using  other,  more  plausible,  compli¬ 
ance  yield  distributions  as  the  null  hypothesis. 

We  thus  see  that  a  critical  step  in  performing  the  hypothesis  testing  calcu¬ 
lations  is  the  assigning  of  assumed  values  to  the  fixed  yield  distribution  which  is 
to  be  used  for  the  null  (compliance)  hypothesis.  It  should  be  noted  that  this 
step  would  not  be  a  problem  under  a  Bayesian  formulation  with  a  uniform  prior 
on  the  yields,  wherein  the  false  alarm  probability  calculation  becomes  a  simple 
posterior  probability.  We  shall  now  repeat  the  hypothesis  test,  this  time  using  a 
different  null  hypothesis  which  we  believe  to  be  closer  to  the  truth  than  the 
assumption  that  all  22  explosions  have  a  yield  of  150  KT.  For  the  fixed  yield  dis¬ 
tribution  Wlt  ....  1^22  we  suggest  that  the  observed  magnitudes  rrij  of  the  USSR 
explosions  be  converted  to  a  hypothetical  distribution  of  compliance  yields  by 
setting  Wj  =  (*n.y  —  a o)//?o  if  this  calculated  yield  is  less  than  150  KT  and  setting 
Wj  =  150  KT  if  it  is  greater  than  that.  The  set  of  values  of  Wj  which  is  obtained 
in  this  manner  is  listed  in  Table  V  for  our  3  trial  values  of  the  parameter  to-  This 
fixed  distribution  of  assumed  yields  resembles  the  calculated  yield  distribution 
of  Table  III  except  that  all  yields  are  forced  to  be  in  compliance.  We  believe  that 
it  is  a  more  realistic  assumption  than  the  previously  discussed  case  in  which  all 
the  hypothesized  yields  are  equal.  An  alternative  approach  would  be  to  shift  all 
the  calculated  yields  down  by  a  constant  amount  so  that  every  event  is  below  the 
150  KT  threshold.  This  approach,  however,  is  tantamount  to  assuming  that  the 
value  of  a<j  is  in  error,  so  we  would  then  be  inconsistent  in  using  that  value  in 


equations  (21)  -  (23).  We  therefore  reject  the  alternative  of  creating  the 
hypothetical  "compliance”  yield  distribution  by  displacing  all  the  computed 
yields  downward  by  a  fixed  amount  in  favor  of  the  approach  of  truncating  Liu; 
calculated  yields  at  150  KT.  One  shortcoming  of  our  approach  is  that  it  would 
caus  number  of  the  yields  to  be  bunched  up  at  the  150  KT  cut-ofT  limit  if  some 
of  the  observed  magnitudes  were  to  exceed  the  magnitude  threshold 
corresponding  to  that  yield  threshold.  This  is  unlikely  to  be  a  valid  model  of  the 
true  distribution  of  yields,  and  it  results  in  larger  values  of  the  thresholds  Ta 
than  those  which  would  be  calculated  if  fewer  compliance  yields  were  as  large  as 
150  KT.  This  problem  is  of  course  less  severe  than  it  was  in  the  previously  dis¬ 
cussed  case  in  which  all  the  yields  were  assumed  to  be  150  KT.  It  could  perhaps 
be  addressed  by  setting  the  compliance  yields  equal  to,  say,  140  KT  if  the  calcu¬ 
lated  yields  are  greater  than  that.  We  have  not  investigated  this  possibility.  It  is 
possible  to  formulate  a  number  of  other  schemes  whereby  the  observed  magni¬ 
tude  distribution  can  be  used  to  generate  a  hypothesized  distribution  of  compli¬ 
ance  yields.  Herein  we  shall  consider  only  the  approach  of  truncating  the  distri¬ 
bution  of  calculated  yields  at  150  KT. 

It  should  be  noted  that  choosing  the  set  of  compliance  yields  on  the  basis  of 
the  observed  data,  as  we  have  described  above,  will  in  fact  violate  the  assump¬ 
tions  under  which  the  false  alarm  probability  has  been  calculated.  In  order  for 
these  calculations  to  be  valid,  the  fixed  set  of  compliance  yields  should  be 
chosen  independently  of  the  data  under  examination.  The  statistical  implica¬ 
tions  of  choosing  the  compliance  yields  for  the  null  hypothesis  on  the  basis  of 
the  observations,  as  we  have  done  herein,  have  not  been  examined.  We  have  cal¬ 
culated  the  false  alarm  rates  and  signal  detection  probabilities  in  the  manner 
described  previously,  as  if  the  null  hypothesis  had  been  chosen  in  advance  of 
examination  of  the  data.  It  should  be  remembered,  however,  that  the  fixed  set 
of  compliance  yields  was  actually  not  selected  in  advance,  so  these  calculations 


arc  not  strictly  valid.  This  criticism,  of  course,  does  not  apply  to  the  results 
shown  in  Table  IV,  which  were  computed  using  an  a  priori  assumption  about  the 
yield  distribution,  albeit  a  rather  implausible  one. 

Table  VI  shows  the  magnitude  and  yield  thresholds  for  rejection  of  the  null 
hypothesis  that  the  yield  distribution  is  as  listed  in  Table  V.  As  in  Table  IV,  the 
thresholds  differ  for  the  2  trial  values  of  y>,  but  now  they  also  differ  for  the  3  trial 
values  of  c0,  since  the  null  hypotheses  in  Table  V  are  different  for  these  3  cases. 
We  thus  have  listed  in  Table  VI  6  sets  of  thresholds  for  rejecting  the  null  (compli¬ 
ance)  hypothesis  with  various  false  alarm  probabilities  a.  As  we  had  anticipated, 
the  thresholds  are  lower  than  are  those  in  Table  IV  which  were  computed  using 
the  null  hypothesis  that  all  the  events  are  barely  in  compliance.  Since  the  larg¬ 
est  magnitude  in  Table  II  is  6.242,  we  see  that  the  null  hypothesis  is  rejected 
with  a  false  alarm  probability  of  5%  if  the  magnitude  bias  is  taken  to  be  0.20  ± 
0.05  and  with  a  false  alarm  probability  of  20%  if  it  is  taken  to  be  either  0.20  ± 
0.10  or  0.25  ±  0.05.  For  the  other  3  cases  considered  in  Table  VI,  the  null 
hypothesis  that  the  yields  are  all  in  compliance  cannot  be  rejected  unless  the 
false  alarm  probability  is  allowed  to  be  greater  than  20%. 

The  hypothesis  tests  which  have  been  applied  so  far  have  all  had  as  the  cri¬ 
terion  for  rejection  that  one  or  more  estimated  log  yields  exceed  a  threshold  T. 
We  shall  now  examine  a  different  test,  which  has  as  its  criterion  for  rejection 
that  2  or  more  estimated  log  yields  exceed  a  threshold  T.  The  threshold  T  will 
of  course  now  be  different  (for  the  same  false  alarm  probability  a),  since  it  is 
less  likely  that  at  least  2  yields  exceed  some  value  than  that  at  least  one  yield 
exceeds  it.  The  procedure  for  evaluating  the  thresholds  Ta  for  this  new 
hypothesis  test  were  shown  in  equations  (24)  -  (27).  Using  the  null  hypotheses 
that  the  yields  (all  in  compliance  with  the  TTBT)  are  as  listed  in  Table  V,  we  find 
that  the  thresholds  for  applying  this  test  are  as  shown  in  Table  VII.  The  2  largest 
magnitudes  in  Table  II  are  6.222  and  6.242,  so  we  see  that  the  compliance 


TABLE  VI 


Yield  thresholds  Yf  at  which  the  TTBT  can  be  monitored  with  a  given  false  alarm 
probability  a.  The  null  hypothesis  is  that  the  yields  are  as  listed  in  Table  V;  it 
will  be  rejected  if  1  or  more  calculated  yields  exceed  the  threshold  Yf. 


Case  1 :  e0  =  0.20  and  if  =  0.05 


Case 


Case 


a 

Yf 

TTLf 

5% 

266.0 

8.240 

10% 

249.5 

8.215 

20% 

231.4 

8.188 

50% 

201.1 

8.132 

2  :  e0 

=  0.20 

and  if  = 

a 

Yf 

TTLf 

5% 

319.0 

8.310 

10% 

288.6 

6.272 

20% 

254.5 

8.223 

50% 

201.7 

8.133 

:  3 :  £q 

=  0.25 

and  if  = 

a 

Yt 

TTLf 

5% 

261.7 

8.284 

10% 

245.3 

8.259 

20% 

227.2 

6.229 

50% 

197.0 

8.174 

4  :  e0 

=  0.25 

and  if  - 

a 

•*  T 

TTLf 

5% 

313.5 

6.354 

10% 

283.5 

6.315 

20% 

249.8 

8.286 

50%  197.6  6.175 
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TABLE  VII 

Yield  thresholds  YT  at  which  the  TTBT  can  be  monitored  with  a  given  false  alarm 
probability  a.  The  null  hypothesis  is  that  the  yields  are  as  listed  in  Table  V;  it 
will  be  rejected  if  2  or  more  calculated  yields  exceed  the  threshold  Yt. 


Case  1  :  Cq  =  0.20  and  <p  -  0.05 


a 

Yr 

TTLt 

5% 

237.3 

6.196 

10% 

224.3 

6.174 

20% 

209.6 

6.148 

50% 

184.3 

6.098 

:  2  :  £0 

=  0.20  and  <p  - 

a 

Yt 

TTLt 

5% 

288.0 

6.271 

10% 

262.0 

6.234 

20% 

230.7 

6.185 

50% 

184.6 

6.099 

:  3  :  c0 

=  0.25  and  <p  = 

a 

Yt 

mT 

5% 

232.0 

6.237 

10% 

219.1 

6.215 

20% 

204.5 

6.189 

50% 

179.5 

6.138 

'  4 :  cp 

=  0.25  and  <p  = 

a 

Yt 

ttit 

5% 

281.0 

6.311 

10% 

255.5 

6.275 

20% 

225.2 

6.226 

50% 

179.8 

6.139 

■>'.  -  .1 
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hypothesis  is  rejected  at  a  significance  level  of  a  =  5%  if  tire  magnitude  bias  is 
0.20  ±  0.05,  at  a  =  10%  if  it  is  0.25  ±  0.05,  at  a  =  20%  if  it  is  0.20  ±  0.10,  and  at 
less  significant  levels  for  the  other  3  possibilities  examined  in  that  table. 

Having  applied  the  hypothesis  testing  procedure  to  the  observed  magni¬ 
tudes,  we  now  ask  the  question  :  if  in  fact  there  was  a  TTBT  violation,  how  likely 
is  it  that  this  procedure  would  have  detected  it  ?  For  each  of  the  hypothesis 
tests  which  we  have  examined,  we  may  answer  this  question  of  effectiveness  by 
again  using  the  formalism  in  equations  (24)  -  (27),  this  time  setting  the  thres¬ 
hold  T  to  the  value  Ta  which  we  have  already  found  and  using  a  hypothesized 
distribution  of  yields  Wlt  Wz.  ....  Wz2  which  violates  the  TTBT  in  some  way.  We 
demonstrate  this  procedure  in  Table  VIII,  using  the  hypothesis  test  that  was 
used  to  generate  Table  VI  (null  hypothesis  of  yields  as  listed  in  Table  V,  rejection 
if  one  or  more  log  yields  exceed  T).  We  shall  evaluate  the  power  of  this 
hypothesis  test  for  detecting  a  TTBT  violation  consisting  of  a  single  event  with 
yield  greater  than  150  KT,  the  other  21  events  having  the  (compliance)  yields 
which  were  hypothesized  for  them  in  Table  V.  We  shall  take  the  violating  event 
to  be  one  of  those  which  was  assumed  in  Table  V  to  be  150  KT.  In  Table  VIII  we 
show  the  increasing  power  of  the  hypothesis  test  to  detect  the  violation  as  we 
increase  its  yield  from  175  KT  to  500  KT.  For  example,  the  table  shows  that  if 
the  magnitude  bias  is  0.20  ±  0.05  and  if  we  displace  one  of  the  150  KT  yields  in 
Table  V  upward  to  175  KT,  then  there  is  a  probability  of  0.070  that  at  least  one 
observed  magnitude  will  exceed  the  threshold  of  7717-  =  6.240  which  was  set  in 
Table  VI  for  monitoring  TTBT  compliance  with  a  false  alarm  probability  of  5%.  If 
the  violating  event  has  a  yield  of  200  KT,  then  the  probability  that  the  compli¬ 
ance  hypothesis  will  be  rejected  at  the  significance  level  a  =  5%  is  0.132.  If  we 
choose  to  monitor  the  TTBT  with  a  false  alarm  probability  of  10%  and  if  the  yield 
of  the  single  violation  is  200  KT,  then  there  is  a  probability  of  0.217  that  at  least 
one  observed  magnitude  will  exceed  the  threshold  m?  =  6.215  and  that  the 


TABLE  VIII 

"Signal"  (violation)  detection  probabilities  for  TTBT  monitoring  with  various  false 
alarm  probabilities  a  when  only  one  event  is  not  in  compliance.  The  hypothesis 
test  is  the  one  which  was  used  in  Table  VI. 


Case  1 :  Cq  =  0.20  and  p  =  0.05 


signal  detection  probability  if  the 
yield  (KT)  of  the  single  violation  is  : 


Case  2  :  to  =  0.20  and  =  0.10 


signal  detection  probability  if  the 
yield  (KT)  of  the  single  violation  is 


426 

.763 

.922 

551 

.848 

.958 

702 

.923 

.983 

.533  .599 


Case  3 :  eo  =  0.25  and  </>  =  0.05 

signal  detection  probability  if  the 
yield  (KT)  of  the  single  violation  is 
0. 


.074 

.144 

.429 

.733 

.971 

.137 

.232 

.549 

.820 

.986 

.254 

.372 

.688 

.897 

.994 

.566 

.677 

.885 

.974 

.999 

violation  will  thereby  be  doLected. 

The  probabilities  which  are  listed  in  Table  VIII  conform  to  a  pattern  which 
we  would  expect.  When  the  yield  of  the  single  violation  is  small,  the  distribution 
of  the  21  r  turned  yields  differs  only  slightly  from  the  null  hypothesis,  so  the 
probability  that  one  or  more  estimated  log  yields  exceeds  the  threshold  T  is 
only  slightly  greater  than  the  false  alarm  probability.  When  the  yield  of  the  sin¬ 
gle  violation  is  great,  the  probability  that  the  compliance  hypothesis  will  be 
rejected  approaches  unity.  We  are  also  able  to  estimate  the  signal  detection 
probability  in  one  intermediate  case.  If  we  set  the  threshold  T  so  high  that  the 
probability  of  a  false  alarm  is  negligible,  then  the  probability  of  detecting  a  sin¬ 
gle  violation  which  has  log  yield  exactly  equal  to  T  is  50%.  We  may  verify  this  for 
"Case  1"  in  Tables  VI  and  VIII.  If  we  set  the  false  alarm  probability  a  at  1%,  we 
find  that  the  yield  threshold  for  rejecting  the  null  hypothesis  is  300.0  KT.  If  we 
change  the  hypothesized  yield  distribution  in  Table  V  so  that  one  of  the  events 
has  a  yield  of  300  KT  rather  than  150  KT,  then  we  find  that  the  probability  that 
one  or  more  estimated  yields  exceed  300  KT  is  0.503. 

Note  that  the  "detection"  in  Table  VIII  is  a  detection  that  the  TTBT  has  been 
violated  by  the  ensemble  of  the  22  events  as  a  whole  rather  than  by  the  single 
event  which  we  have  chosen  to  be  in  violation.  That  is,  there  is  a  chance  that  the 
event  which  we  have  set  to  have  the  yield  greater  than  150  KT  will  have  a  magni¬ 
tude  less  than  the  threshold  mT,  and  there  is  a  chance  (very  nearly  equal  to  the 
false  alarm  probability  a)  that  one  or  more  of  the  other  events  have  a  magni¬ 
tude  greater  than  m.?,  so  we  cannot  definitely  say  that  it  was  the  violating  event 
which  led  to  rejection  of  the  compliance  hypothesis.  Of  course,  as  the  yield  of 
the  violating  event  is  allowed  to  increase,  most  of  the  power  of  the  test  shown  in 
Table  VIII  is  due  to  the  probability  that  the  magnitude  of  that  particular  event 


We  can,  of  course,  use  other  violation  patterns  sm  h  •  one  cut  with  a 
yield  of  200  KT  and  another  with  a  yield  of  250  KT  as  an  alternative  to  the  single¬ 
event  violation  pattern  which  was  used  in  Table  VIII.  We  can  also  calculate  the 
’'signal”  (i.e.,  violation)  detection  probability  for  the  different  hypothesis  tests 
which  were  used  in  Tables  IV  and  VII.  The  violation  pattern  which  is  used  in 
these  calculations  need  not  be  the  same  one  as  that  upon  which  rejection  of  the 
hypothesis  is  based;  for  instance,  we  can  calculate  the  signal  detection  probabil¬ 
ity  of  the  "2  or  more  exceedences"  test  shown  in  Table  VII  using  a  single-event 
violation  pattern  as  we  did  in  Table  VIII.  Of  course,  we  do  not  expect  that  this 
particular  hypothesis  test  would  be  very  powerful  for  detecting  this  particular 
violation  pattern.  We  thus  see  that  the  hypothesis  test  should  be  designed  to 
reject  the  compliance  hypothesis  for  some  TTBT  violation  pattern  which  we 
expect  would  be  useful  for  weapons  development  and  that  the  "one  or  more 
exceedences"  test  which  was  used  in  Tables  IV  and  VI  may  not  be  the  most 
powerful  one  for  detecting  this  pattern  of  violations.  We  shall  next  examine  the 
question  of  what  is  the  most  powerful  hypothesis  test  in  general. 

3.2.  Optimal  Hypothesis  Test 

It  is  clear  that  the  threshold  value  Ta  can  be  determined  for  any  number  of 
events  n  by  setting  the  false  alarm  probability  at  a,  but  it  is  not  clear  what  kind 
of  violation  we  would  like  to  detect.  Any  assumed  pattern  of  violations  can  be 
converted  to  a  signal  detection  probability  for  the  given  false  alarm  probability 
a.  For  example,  in  the  hypothesis  test  in  which  the  log  yields  are  all  equal  to  the 
same  compliance  value  W,  one  pattern  might  be  systematic  cheating,  i.e., 
Wj  =  Yf  +  A  for  all  j ,  or  another  pattern  might  be  a  selective  outlier  violation, 
i.e. ,  Wj  —  Iff  for  j  i*k  and  Wk  =  W  +  A  for  the  k  th  event.  So  far  we  have  set  thres¬ 
holds  Ta  by  considering  only  the  particular  violation  patterns  of  one  or  more,  or 
two  or  more,  estimated  yields  Wfst  exceeding  Ta.  We  now  consider  more  general 


violation  patterns. 


One  point  of  interest  is  that  statistical  theory  gives  an  optimal  test  for  any 
given  null  hypothesis 

H,:W  =  W, 

against 

Hz :  W  =  W2 

where  W  =  (  Wlt  W 2 .  fyn  )'  is  the  nxl  yield  vector.  The  Neyman-Pearson  lemma 

gives  the  most  powerful  test  of  H2  against  Hi  for  a  given  false  alarm  probability. 
This  means  that  the  probability  of  detecting  a  violation  of  the  form  H2  is  highest 
for  the  given  false  alarm  probability.  This  test,  which  is  given  below,  is  not 
equivalent  to  the  one  discussed  earlier  with  false  alarm  probability  (7)  which  is 
based  on  rejection  if  one  or  more  magnitudes  exceed  T.  The  optimal  test,  how¬ 
ever,  leads  to  intractable  computations  unless  certain  approximations  are 
made. 

Suppose  that  we  wish  to  develop  the  test  of  H2  against  Hi  which  implies  that 
under  H*.  the  distribution  of  m  =  (mi,  m2,  ....  m,, )’  is  multivariate  normal  with 
mean 


fii  =  1  ao  +  lfi  @q 

and  covariance  matrix 


S*  = 


2  (T,W<')  +  Diag  (erf.. . ..cr^) 


(29) 


(30) 


where  T  =  (1,  1 .  l)  and  lfi'  =  (  Wix .  )  and  Diag  (of .  o%)  denotes  an 

nxn  diagonal  matrix.  If  we  develop  the  test,  it  leads  to  rejecting  compliance 
when 


Q(m)  -  |~m' (Sf1  -E2')m  +  (/T2E2  1  -/x'jS/Jm  (31) 


exceeds  some  threshold.  The  distribution  theory  is  difficult  for  this  case  and 


even  if  one  assumes  £  =  2i  s  S2.  the  resulting  linear  discriminant  function  still 
depends  on  the  assumed  yield  vectors  Wi  and  W2,  i.e. , 

Q'(m)  =  0O(W2  -  WO'  S-'m  .  (32) 

The  false  alarm  and  signal  detection  probabilities  can  be  specified  for  any  Wt  and 
W2  since  Q'(m)  will  have  a  univariate  normal  distribution  with  means 

7<=0o(W2-W (33) 

under  H<,  i=l,2  and  variance 

0%  =  0!  (W2  -  Wi)’  2-1  (W2  -  WO  (34) 

under  both  hypotheses.  In  this  case,  the  problem  with  the  critical  region 
defined  by  (32)  is  that  the  value  of  $'(m)  can  be  manipulated  by  running  a  series 
of  tests  at  a  low  level  to  keep  the  linear  function  below  the  critical  value  for 
rejecting  the  null  hypothesis,  as  can  be  seen  by  considering  the  behavior  of  the 
right-hand  side  of  (32)  when  several  of  the  to  components  of  m  are  small.  This  is 
in  contrast  to  the  hypothesis  test  discussed  previously  for  which  the  null 
hypothesis  was  rejected  if  there  were  one  or  more  exceedences  of  the  threshold 
Ta.  Since  we  are  not  playing  against  nature,  it  would  seem  to  be  preferable  to 
stick  with  suboptimal  critical  regions  of  the  form  implied  by  the  false  alarm  rate 
(7),  since  they  will  be  sensitive  to  one-time  only  violations  and  are  not  subject  to 
manipulation  by  an  adversary. 


MAGNITUDE -YIK1J)  UKURKSS10N  ANALYSIS 


We  have  thus  far  considered  the  coefficients  au  and  /?q  to  be  given  quanti¬ 
ties,  and  we  have  not  addressed  the  problem  of  how  they  might  be  calculated 
from  the  calibration  data  of  magnitudes  for  explosions  with  known  yields.  We 
shall  now  present  a  technique  for  determining  these  parameters  which  treats 
both  the  magnitudes  and  the  yields  of  the  calibration  explosions  as  random  vari¬ 
ables.  First,  we  shall  consider  the  simpler  approach  of  treating  only  the  magni¬ 
tudes  as  random  variables.  We  shall  finally  apply  both  of  these  techniques  to  a 
particular  data  set  in  order  to  obtain  the  results  which  were  listed  in  Table  1  and 
which  were  used  in  the  last  section  of  this  report  for  testing  TTBT  compliance. 

1.  Weighted  Least-Squares  Solution 

We  adopt  equation  (l)  as  a  model  of  the  magnitude-yield  relation,  where  we 
consider  the  log  yields  Wj  to  be  fixed  quantities  and  the  magnitudes  rrij  to  be 
measurements  characterized  by  errors  ej  of  size  Oj.  That  is,  the  Wj  are 
assumed  to  be  known  with  arbitrary  precision  whereas  the  rrij  are  treated  as 
random  variables  having  normal  distributions  with  means  a  +  @  Wj  and  variances 
of.  We  may  then  obtain  estimates  of  the  parameters  a  and  /?  by  the  standard 
technique  of  weighted  least  squares  (where  the  weights  are  the  reciprocals  of 
the  variances  of).  We  define  : 

Si  =  £1/*/ 

5Z  =  'Efyj/of 

s3  =  'EWf/of  (35) 

s4  =  Yjrni/ °1: 

S6  =  IlrnJWj/of 

We  obtain  estimates  of  a  and  (i  from 


which  results  in 


a«S(  _  S3S4  ~  S2S* 
S}Sg  ~  SI 

ff»t  -  S'S5  ~l3S* 
P  S,S 3  -  Si 


(37) 

(38) 


The  variance-covariance  structure  of  the  least-squares  estimates  is  given  by 


S !  Sz 

-1 

1 

S3  ~Sg 

Oaf, 

Sg  Sg 

“  5,53  -  Si 

-Sz  S ! 

(39) 


As  in  equation  (3),  we  must  add  to  of  a  term  <pz  to  account  for  the  variance  in 
the  estimate  of  the  magnitude  bias  between  the  calibration  test  site  and  the  test 
site  at  which  the  magnitude-yield  relation  is  to  be  applied.  Since  we  are  con¬ 
cerned  here  only  with  the  calibration  data,  we  shall  not  include  this  additional 
term  except  when  we  make  a  comparison  with  the  values  which  were  computed 
using  equation  (3). 


2.  Maximum  likelihood  Estimation 

We  shall  now  consider  an  improved  model  of  the  magnitude-yield  relation 
which  treats  the  yields  of  the  calibration  explosions  as  being  measured  quanti¬ 
ties  which  are  subject  to  some  uncertainty.  Another  feature  of  this  improved 
model  is  the  incorporation  of  a  term  which  explicitly  takes  coupling  into  account 
rather  than  treating  it  as  a  component  of  the  magnitude  measurement  error. 
The  new  model  of  the  magnitude-yield  relation  is 

nij  -  a  +  fi  Wj  +  ej  +  Cj  (40) 

The  term  ej  represents  the  error  in  the  magnitude  rrij.  As  before,  this  random 
variable  is  normally  distributed  with  mean  zero  and  variance  of.  The  log  yield 
Wj  is  now  considered  to  be  a  random  variable  also.  We  define  its  mean  and  vari¬ 
ance  as  ft  and  rf,  respectively.  Equation  (40)  differs  from  equation  (l)  in  that 


an  additional  term,  r.j,  has  been  included  to  treat  the  variability  of  source  cou¬ 
pling  among  the  n  calibration  events.  In  equation  (l).  for  which  the  mean  values 
do  and  0o  of  the  random  variables  a  ana  0  were  specified  a  priori ,  the  magnitude 
scatter  due  to  coupling  was  incorporated  into  the  magnitude  error  term  ej.  As 
was  explained  in  the  discussion  of  Equation  (l),  the  variance  of  of  the  error  term 
ej  comes  from  two  sources  :  the  error  in  the  measurement  of  mb,  and  the 
scatter  in  for  a  fixed  yield  due  to  variations  in  coupling  efficiency.  In  order 
to  derive  new  estimates  a***  and  fS*tl  as  alternatives  to  the  a  priori  values  do  and 
0o.  in  equation  (40)  it  is  necessary  to  separate  the  two  components  of  the  vari¬ 
ance,  since  the  magnitude  measurement  variance  is  known  for  each  event  (given 
the  number  of  detecting  stations  and  the  mb  residual  at  each  station)  but  the 
coupling  scatter  is  unknown.  We  denote  the  variance  of  the  magnitude  error  e; 
as  of  and  the  variance  of  the  coupling  term  Cj  as  of.  Note  that  we  assume  this 
variance  to  be  a  single  constant  for  the  n  calibration  explosions.  The  model 
would  require  further  modification  if  it  were  believed  that  the  coupling  variabil¬ 
ity  were  greater  among  some  subsets  of  the  n  explosions  than  among  others. 
This  would  be  the  case,  for  example,  if  the  calibration  explosions  were  detonated 
at  geologically  dissimilar  regions  within  the  test  site,  and  it  would  be  especially 
important  if  the  source  media  were  not  the  same  for  all  the  explosions.  In  this 
study,  we  shall  assume  that  the  geological  heterogeneity  among  the  n  sources 
can  be  characterized  by  the  single  value  oc . 

The  regression  which  is  treated  by  the  new  model  differs  from  the  one  which 
was  solved  by  weighted  least  squares  in  that  now  both  the  magnitudes  and  the 
yields  of  the  explosions  are  regarded  as  random  variables.  (The  model 
described  in  the  previous  section  corresponds  to  the  case  rf  =  0.)  The  model  of 
the  magnitude-yield  relation  in  equation  (40)  is  thus  characterized  by  the  known 
means  and  variances  pj  and  rf  of  the  log  yields  Wj,  the  known  variances  of  of 
the  magnitude  errors  ej,  and  the  unknown  variance  of  of  the  coupling  scatter 


Cj.  We  obtain  maximum- likelihood  estimates  for  the  parameters  a  and  p  in  this 
model  by  an  iterative  approach.  As  a  first  approximation,  we  take  a  and  p  to  be 
the  values  which  were  found  using  the  weighted  least-squares  method  described 
previously.  An  initial  value  will  be  guessed  for  the  coupling  variance  of.  We  then 


define 


V  f  =  P2'r?  +  af  +  of  (41) 

The  likelihood  function  for  estimating  a  and  P  is  given  by 

log  A  =  -  7r£log(r)?)  -  (mj  -  a  -  Pujf/rif  (42) 

c  i- i  6 i 

We  shall  obtain  estimates  for  a  and  p  (simultaneously  with  estimates  for  the  log 
yields  Wj)  by  maximizing  this  function.  The  variances  and  covariances  of  the 
estimates  of  Wj  and  are  given  by 

o\  =  t/(1  —  fPrf/  r]f) 

ofj  =  of(  1  —  of/  rjf)  (43) 

0riV  =  ~^Tfaf/rif 

The  estimates  of  the  random  variables  Wj  and  ej  themselves  are  given  by 

Wf*  =  Hj  +•  ("V  -  a  -  P»f)M/rlf  (44) 

«/**  =  (mj  -  a  -  pHj)oj/r)f  (45) 

We  denote  the  averages  over  the  n  explosions  of  Wf’*  and  as  W£ 5i  and 
and  the  average  of  mj  as  m, M .  We  then  obtain  as  new  estimates  of  the  parame¬ 


ters  p  and  a 


£(W/rf  -  WSfi\mj  -  nijv, )  -  £[(W/*  -  W"i)(e/“  -  e'a%)  +  a*,.,] 


£[(»r‘  -  WSSi)B  +  "1,1 


a  =  m-v,  -  -  e”‘ 


Finally,  we  obtain  a  new  value  for  the  variance  of  the  coupling  scatter  as 

Oo  =  “  a  -fiWJst)z  +  pzol  +  2 paVo  +  a|  ]  <4H> 

The  sequence  of  equations  (41)  and  (43)  -  (48)  is  repeated  until  the  estimates  of 
all  the  parameters  converge  and  the  likelihood  function  (42)  stabilizes. 

3.  Application  to  Calibration  Data 

We  shall  apply  the  regression  analysis  which  we  have  just  described  to  the 
data  listed  in  Table  IX.  As  is  indicated  in  that  table,  the  events  which  we  shall 
use  for  calibration  were  detonated  at  physically  distinct  test  sites  and  in 
different  media.  In  order  for  the  calibration  to  have  relevance  for  the  Shagan 
River  events  in  Table  II,  we  should  restrict  the  calibration  events  to  those 
detonated  in  granite,  since  this  source  medium  is  presumed  to  have  coupling 
properties  similar  to  those  of  the  emplacement  medium  at  Shagan.  Due  to  the 
paucity  of  data  for  explosions  in  granite,  however,  we  shall  ignore  the  restriction 
of  a  single  source  medium  and  we  shall  use  for  calibration  the  collection  of 
events  listed  in  Table  IX.  Although  this  procedure  may  prove  inadequate  for  cali¬ 
brating  the  magnitude-yield  regression  in  practice,  it  will  serve  our  needs  of 
generating  the  values  which  were  listed  in  Table  I  and  which  were  used  for  illus¬ 
tration  purposes  in  our  examples  of  TTBT  compliance  testing.  The  magnitudes 
and  yields  which  are  listed  in  Table  IX  were  taken  from  Blandford  et  at.  (1983). 
The  magnitudes  were  computed  by  means  of  a  generalized  linear  model  [GLM] 
which  permits  the  calculation  of  station  magnitude  effects  simultaneously  with 
the  event  magnitudes  and  corrections  for  the  clustering  of  events  at  a  common 
test  site.  (This  latter  effect  leads  to  correlations  in  the  data.)  Corrections  were 
also  made  to  the  magnitudes  for  the  attenuation  parameter  t*  and  for  interfer¬ 
ence  between  the  P  and  pP  pulses.  The  t  *  corrections  reduce  the  data  to  an 
equivalent  single  test  site  (NTS),  so  the  magnitude  bias  c<j  which  we  have  used  for 


Events  used  for  magnitude  -  yield  regression 
(data  taken  from  lllandford  et  al.,  1983) 


event 

date 

site 

medium 

Y  (KT) 

SHOAL 

10/26/63 

Fallon,  Nev. 

granite 

12.2 

REX 

2/24/66 

Pahute  Mesa 

tuff 

19.0 

RUBIS 

10/20/63 

Algeria 

granite 

52.0 

PILEDRIVER 

6/2/66 

Climax  Stoek 

granite 

56.0 

LONG  SHOT 

10/29/65 

Amehitka 

andesite 

80.0 

SAPHIR 

2/27/65 

Algeria 

granite 

120.0 

SCOTCH 

5/23/67 

Pahute  Mesa 

tuff 

155.0 

BILBY 

9/13/63 

Yueea  Flat 

tuff 

235.0 

MILROW 

10/2/69 

Amehitka 

lava 

1000.0 

BENHAM 

12/19/68 

Pahute  Mesa 

tuff 

1150.0 

HANDLEY 

3/26/70 

Pahute  Mesa 

tuff 

1200.0 

BOXCAR 

4/26/68 

Pahute  Mesa 

rhyolite 

1300.0 

testing  the  TTBT  compliance  of  the  Shag  an  River  events  was  relative  to  NTS. 

In  order  to  perform  the  simplest  regression  which  could  be  carried  out 
using  these  data,  one  would  assume  that  all  the  yields  are  known  exactly  (i.«  , 
that  Tj  =  0  for  all  j ),  and  then  one  would  perform  a  weighted  least-squares  fit 
with  all  the  weights  of  equal  to  one  another.  As  can  be  seen  from  equations  (35) 
-  (38),  the  estimated  values  of  a  and  /S  are  independent  of  the  value  chosen  for 
of,  so  long  as  of  is  the  same  for  each  event.  As  equation  (39)  shows,  however, 
the  variances  and  covariance  of  these  variables  are  a  function  of  the  constant 
of,  so  we  cannot  choose  this  constant  arbitrarily.  The  straightforward  approach 
would  be  to  choose  some  value  for  of,  compute  estimates  of  a  and  /3  using  equa¬ 
tions  (37)  and  (38),  and  then  compute  the  magnitude  residual  Rj  =  nij  -  a  -  (3  Wj 
for  each  event.  The  common  magnitude  variance  for  all  events  would  then  be 
given  by 

af  =  oz  =  S("V  “““W2  (49) 

n  a 

and  this  value  would  be  used  in  equation  (39)  to  compute  of,  of,  and  oap  for  the 
least-squares  estimates.  Instead  of  this  procedure,  however,  we  shall  simply  use 
the  values  for  oj  which  were  given  by  Blandford  et  a l.  (1983)  and  which  are 
listed  in  Table  IX.  Note  that  these  values  are  not  exactly  the  same  for  every 
event. 

When  we  apply  the  least-squares  technique  of  equations  (37)  -  (39),  we 
obtain  aa  =  3.884,  fa  =  0.899,  oa  =  0.031,  Of,  =  0.013,  and  oap  =  -0.000393.  We 
have  used  these  last  3  values  in  Table  I.  In  order  to  apply  the  maximum- 
likelihood  technique  of  equations  (46)  -  (48),  we  must  assign  a  standard  deviation 
Tj  to  the  value  of  the  log  yield  of  each  calibration  event,  which  is  now  taken  to  be 
a  quantity  subject  to  error.  We  shall  assume  that  the  yields  Yj  are  known  to 
within  some  precision  &Yj,  and  we  set 


If  the  fractional  precision  of  the  measured  yield  Ay,-  /  is  suitably  small,  we  ran 
approximate  the  distribution  of  the  log  yield  Wj  as  being  normal  with  standard 
deviation  Tj.  We  shall  arbitrarily  assume  that  the  yields  are  known  to  within  a 
fractional  precision  AJy/  Y}-  of  10%,  and  we  shall  substitute  this  value  into  equa¬ 
tion  (89)  in  order  to  find  a  common  value  of  Tj  which  will  be  used  for  every  event 
in  the  maximum-likelihood  regression.  This  procedure  results  in  values  of  a0  = 
3.882,  /30  =  0.890,  and  ac  =  0.07.  These  values  were  used  in  Table  I.  (Recall  that 
the  value  of  Oj  in  Table  1  is  given  by  the  square  root  of  the  sum  of  the  variances 
of  +  ol,  where  the  magnitude  standard  deviation  am  was  taken  to  be  0.02  for 
every  event.)  We  have  thus  mixed  the  values  of  the  slope  and  intercept  of  the 
maximum-likelihood  regression  with  the  vartance-covariancc  structure  of  those 
values  which  were  obtained  using  the  least-squares  regression.  We  have  done 
this  because  we  have  not  extended  the  maximum-likelihood  approach  to  evalu¬ 
ate  <7fl.  Op  and  oap.  We  believe  that  only  a  small  error  is  introduced  by  using  the 
least-squares  estimates  of  these  parameters,  however,  since  the  values  of  a0  and 
/S0  which  were  obtained  by  both  techniques  are  so  nearly  the  same. 


CONCLUSIONS 


We  have  applied  a  weighted  least-squares  regression  and  an  iterative  least- 
squares  regression  to  obtain  estimates  of  the  parameters  which  relate  >-'3isrnic 
magnitudes  to  yields.  The  results  of  these  2  analyses  were  quite  similar.  The 
least-squares  regression  permitted  the  determination  of  the  variance- 
covariance  structure  of  the  slope  and  intercept  of  the  magnitude-yield  relation, 
and  the  maximum-likelihood  regression,  which  treats  the  calibration  yields  as 
uncertain  values,  permitted  the  calculation  of  the  magnitude  scatter  due  to 
source  coupling.  The  data  which  were  used  to  calibrate  the  magnitude-yield 
relation  were  not  uniform  with  respect  to  test  site  and  source  medium,  so  the 
values  which  were  determined  here  ought  to  be  used  only  for  illustrating  the 
TTBT  compliance  testing  procedures  and  not  for  monitoring  the  TOIT  in  prac¬ 
tice. 

The  parameters  which  resulted  from  the  regression  analyses  were  applied 
first  to  the  corriJ>v^ation  of  confidence  limits  surrounding  estimates  of  the  yields 
for  22  Shagan  River  explosions  Mid  then  to  a  test  of  the  hypothesis  that  all  22 
explosions  were  in  compliance  with  the  TTBT  limit  of  150  KT.  The  assigning  of 
confidence  limits  to  the  yields  is  effective  for  considering  each  one  of  the  22 
events  separately,  but  it  cannot  be  used  to  consider  all  the  events  collectively 
since  the  confidence  limits  are  correlated  among  events.  This  correlation  comes 
about  from  the  uncertainty  in  the  parameters  which  are  used  for  the 
magnitude-yield  relation  and  especially  from  the  uncertainty  in  the  size  of  the 
USSR  -  US  magnitude  bias.  It  was  demonstrated  that  testing  the  null  hypothesis 
that  all  22  events  were  in  compliance  is  an  effective  way  of  monitoring  the  TTBT. 
Tests  were  performed  which  rejected  the  null  hypothesis  of  compliance  if  one  or 
more,  or  2  or  more,  estimated  log  yields  exceeded  some  threshold  T.  Neither  of 
these  tests  is  optimum,  but  it  was  shown  that  the  optimum  test  is  impractical 


because  it  is  susceptible  to  failure  if  a  scries  of  low-yield  explosions  are  included 
among  the  events  being  monitored. 

It  was  shown  that  on  account  of  the  uncertainties  in  the  seismic  magni¬ 
tudes,  in  the  magnitude-yield  relation,  and  in  the  USSR  -  US  magnitude  bias,  it  is 
necessary  to  set  the  threshold  T  for  rejecting  the  null  (compliance)  hypothesis 
at  a  level  which  far  exceeds  the  TTBT  limit  of  150  KT  in  order  to  be  able  to  per¬ 
form  the  test  with  a  suitably  low  probability  of  issuing  a  false  alarm  of  TTBT  vio¬ 
lation.  The  power  of  one  particular  hypothesis  test  was  measured  by  using  a  dis¬ 
tribution  of  yields  which  had  a  single  violation  of  the  150  KT  limit  and  computing 
the  probability  that  the  null  hypothesis  would  be  rejected  for  the  estimates  of 
those  yields.  This  power  testing  procedure  can  also  be  applied  to  the  other 
hypothesis  tests  and  to  other  yield  distributions  containing  violations.  An 
important  step  in  designing  a  hypothesis  test  is  the  assumption  of  the  distribu¬ 
tion  of  yields,  all  in  TTBT  compliance,  which  is  to  be  used  as  the  null  hypothesis. 
Two  methods  for  creating  this  yield  distribution  were  used.  One  was  the  assump¬ 
tion  that  all  22  events  had  yields  of  150  KT,  and  the  other  was  the  creation  of  an 
ad  hoc  yield  distribution  using  the  observed  magnitudes.  The  latter  method, 
while  not  strictly  valid  from  a  theoretical  viewpoint,  may  be  more  useful  in  prac¬ 
tice. 
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